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ABSTRACT 

In  this  paper  we  propose  an  extension  of  grayscale  histogram 
equalization  for  color  images.  For  aesthetic  reasons,  previ¬ 
ously  proposed  color  histogram  equalization  techniques  do 
not  generate  uniform  color  histograms.  Our  method  will 
always  generate  an  almost  uniform  color  histogram  thus 
making  an  optimal  use  of  the  color  space.  This  is  partic¬ 
ularly  interesting  for  pseudo-color  scientific  visualization. 
The  method  is  based  on  deforming  a  mesh  in  color  space 
to  fit  the  existing  histogram  and  then  map  it  to  a  uniform 
histogram.  It  is  a  natural  extension  of  grayscale  histogram 
equalization  and  it  can  be  applied  to  spatial  and  color  space 
of  any  dimension. 

1.  INTRODUCTION 

Contrast  enhancement  is  a  central  problem  of  many  image 
processing  applications  and  Grayscale  Histogram  Equaliza¬ 
tion  (GHE)  is  one  of  the  simplest  and  most  effective  primi¬ 
tives  for  that  purpose. 

Given  a  grayscale  image  /,  its  histogram  Hi(i)  is  de¬ 
fined  as  the  relative  frequency  of  appearance  of  intensity  i. 
In  GHE  (see  [1,  2]),  the  intensity  i  =  I (p)  of  every  pixel  p 
is  transformed  to  j  =  J(p)  =  Hf(i)  where  Hf  =  f  Hi 
is  the  cumulative  histogram  associated  with  Hi.  The  result¬ 
ing  image  J  is  equalized,  by  definition,  its  histogram  Hj 
is  uniform  which  is  equivalent  to  saying  that  all  grayscale 
values  are  represented  by  the  same  number  of  pixels.  This 
often  results  in  spectacular  subjective  contrast  enhancement 
(fig.  3(a)  and  3(b)).  Histogram  specification,  an  extension 
of  this  technique,  allows  for  any  (not  necessarily  constant) 
user- supplied  histogram. 

Extending  GHE  to  color  images  is  not  straightforward 
and  various  methods  have  been  proposed  to  address  this  im¬ 
portant  problem. 

The  most  simple  extension  is  to  apply  GHE  indepen¬ 
dently  to  the  different  bands  of  the  color  image.  Another 
idea  is  to  spread  the  histogram  along  its  principal  compo¬ 
nent  axes  [3]  or  along  the  brightness  component  of  the  im¬ 
age  [4,  5].  All  these  techniques  only  use  marginal  color 
histograms  and  therefore  do  not  take  into  account  the  corre¬ 
lation  between  the  different  bands.  In  [6]  a  more  interesting 
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approach  is  proposed  that  tries  to  extend  the  cumulative  his¬ 
togram  to  higher  dimension. 

If  all  these  techniques  increase  the  subjective  contrast 
of  color  images,  they  all  fail  to  produce  a  truly  uniform 
color  histogram.  The  main  reason  might  be  that  contrar- 
ily  to  the  grayscale  case,  imposing  a  uniform  histogram  for 
a  color  image  results  in  the  perception  of  severe  color  dis¬ 
tortion.  This  perception  can  be  explained  (see  [7])  by  the 
difference  between  scotopic  vision  (monochromatic  used 
mainly  in  varying  low  light  conditions)  and  photopic  vision 
(color  used  in  standard  lighting  conditions).  However,  for 
many  scientific  and  technical  applications,  aesthetic  con¬ 
siderations  are  not  prevalent.  When  visualizing  pseudo¬ 
color  images  (multispectral  satellite  pictures  for  example), 
all  available  colors  should  be  used. 

2.  IDEA 

Given  a  vector- valued  image  I  =  [ii, ...,  In\,  its  histogram 
Hi{ii, ...,  in)  :  Mn  -A  M  is  defined  as  the  relative  fre¬ 
quency  of  occurrence  of  color  [G, ...,  in\.  We  want  to  create 
a  transform  T  :  ln  A  ln  such  that  the  image  J(x ,  y)  = 
T(I(x,y))  is  equalized i.e.  Hj(i i,  ...,in)  is  constant. 

From  now  on,  to  simplify  notations  we  will  consider  the 
case  n  =  2.  The  images  will  be  represented  using  red  and 
green.  Our  results  remain  applicable  to  any  higher  dimen¬ 
sional  color  and/or  spatial  space. 

We  can  see  T  as  a  deformation  of  the  color  space  M2 . 
Therefore  a  good  description  for  T  is  the  way  it  maps  one 
mesh  to  another  mesh.  For  example,  imagine  that  we  know 
a  mesh  M/  which  is  mapped  to  a  regular  uniform  mesh  Mj 
(fig.  1).  It  is  then  possible  to  construct  a  piecewise  linear 
approximation  Tpw  of  T  by  considering  that  all  triangular 
half-cells  of  vertices  pi ,  qi  and  rj  will  be  linearly  mapped 
to  the  corresponding  triangle  of  vertices  pj  =  T(pi),  qj  = 
T(qi )  and  rj  =  T(r/).  Using  the  barycentric  coordinates, 
d  =  api  +  f3qi  +  777  and  we  can  define  Tpw  by: 

Tpwic!)  =  apj  +  f3qj  +  yrj  (1) 

Consider  a  pixel  (#,  y)  of  the  image.  Its  color  is  the 
vector  ci  —  /(x,  y).  As  M/  is  a  mesh  of  the  color  space,  c/ 
is  within  a  certain  cell  Kp  By  definition  of  M/  and  Mj,  all 
points  ci  of  K i  are  mapped  to  points  cj  =  T(c/)  of  a  cell 
Kj  =  T(Ki )  of  Mj  through  T.  But  as  J  is  an  equalized 
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Fig.  1.  The  transformation  T  can  be  represented  by  a  mesh 


image,  and  Mj  is  uniform,  it  follows  that  all  cells  of  Mj 
contain  exactly  the  same  number  of  points.  Therefore  this 
must  also  hold  for  Mj. 

The  only  remaining  difficulty  is  therefore  to  find  a  suit¬ 
able  mesh.  Starting  from  a  uniform  N  x  N  mesh,  we  can 
converge  to  a  solution  (fig.  2)  by  iteratively  expanding  all 
cells  Ki  that  do  not  contain  enough  points  (n^y  —  > 

0)  and  contracting  cells  that  already  contain  too  many  points 
(nxny  _  <  Q)  This  is  done  by  moving  the  vertices 

Pi,  qi,  ri  of  each  cell  Kj  towards  the  centroid  or  away 
from  it.  This  leads  to  the  following  differential  equation: 


dpi  _  , 
dt  1 


TlxTiy 

N2 


~  nKl )  0 Pi  ~  °K! ) 


(2) 


where  nj,  ny  are  the  dimensions  of  the  image  and 
is  the  number  of  pixels  of  the  image  whose  colors  are  within 
cell  Ki.  At  the  steady  state  =  n^JiY  is  constant,  all 
cells  contain  the  same  number  of  points. 


Fig.  2.  Mesh  deforming  to  fit  histogram  on  figure  4(d) 


3.  ALGORITHM 

Outline  of  the  algorithm  : 

•  determine  the  color  histogram  Hi  of  the  original  im¬ 
age  I. 

•  deform  a  mesh  Mi  on  the  color  space  to  fit  the  his¬ 
togram  Hi .  (equation  2) 


•  use  Mi  to  define  a  piecewise  linear  deformation  Tpw 
of  the  color  space.  All  cells  of  M/  are  linearly  mapped 
to  corresponding  cells  of  the  uniform  mesh  Mj.  (equa¬ 
tion  1) 

•  compute  the  equalized  image  J  =  Tp^/(/). 

4.  RELATION  WITH  GRAYSCALE  HISTOGRAM 
EQUALIZATION 

This  formalism  may  seem  extremely  far  from  the  simple 
“use  the  cumulative  histogram  approach”  of  GHE.  We  will 
now  show  that  it  is  in  fact  a  very  natural  extension. 

Image  3(b)  is  the  result  of  a  GHE  on  image  3(a).  To 
compute  the  output  of  our  algorithm,  we  determine  the  his¬ 
togram  of  the  original  image  and  then  generate  a  mesh  such 
that  each  cell  (here  each  interval)  contains  the  same  number 
of  pixels  (fig.  3(c)).  Colors  of  the  original  image  are  then 
piecewise  linearly  mapped  to  the  same  position  in  a  cor¬ 
responding  uniform  mesh.  Therefore  by  construction,  the 
histogram  is  equalized  (fig.  3(d)). 

Clearly  the  limits  of  the  cells  of  this  optimal  mesh  have 
to  be  Hc  1(k/N)  with  k  =  0...N  where  Hc  is  the  cu¬ 
mulative  histogram.  Therefore,  as  shown  on  figure  3(e)  the 
proposed  equalization  is  a  piecewise  linear  approximation 
of  the  grayscale  histogram  equalization  (GHE)  method. 

5.  EXAMPLES 

In  this  section  we  will  compare  the  result  of  traditional  in¬ 
dependent  band  GHE  and  the  proposed  color  equalization 
on  2  pseudo-color  images.  We  will  see  that  the  proposed 
transform  equalizes  almost1  perfectly  the  color  histogram 
and  thus  makes  an  optimal  use  of  all  available  colors. 

Figure  4(e)  is  the  original  red-green  image  of  the  head  of 
a  moth  as  observed  with  an  Environmental  Scanning  Elec¬ 
tron  Microscope.  As  we  can  see  on  the  histogram  (fig. 
4(d)  -  for  every  color  (r,  g)  the  probability  of  occurrence 
is  mapped  to  the  diameter  of  a  disc),  the  red  and  green  com¬ 
ponents  of  this  pseudo-color  image  are  strongly  correlated2. 
Moreover,  the  marginal  histograms  Hr  and  Hq  are  already 
almost  uniform.  Therefore  independent  band  GHE  has  al¬ 
most  no  effect  (fig.  4(c))  and  the  resulting  histogram  (fig. 
4(a))  is  clearly  not  equalized. 

On  the  contrary,  the  proposed  color  histogram  equaliza¬ 
tion  produces  a  much  more  colorful  image  (fig.  4(h))  and 
its  histogram  (fig.  4(f))  is  almost1  perfectly  uniform. 

It  is  extremely  instructive  to  consider  the  2  meshes  as¬ 
sociated  with  these  2  transforms  (fig.  4(b)  and  4(g)).  Note 
that  even  though  independent  band  GHE  does  not  explicitly 
use  such  an  object,  as  a  transform  it  can  be  represented  by  a 

1  rigorously,  as  in  the  case  of  GHE,  the  discrete  nature  of  digital  images 
does  not  necessarily  allow  for  a  perfectly  constant  histogram.  For  example 
the  total  number  of  pixels  might  not  be  divisible  by  the  number  of  colors. 

2This  is  not  the  original  ESEM  image.  It  was  processed  by  the  authors 
for  the  purpose  of  the  demonstration. 


(a)  Original  im-  (b)  Grayscale- 
age  equalized  image 


(c)  Histogram  of  original  image  image 
and  corresponding  mesh 


(d)  Histogram  of  grayscale-equalized  im¬ 
age  and  uniform  mesh 


(e)  Cumulative  histogram  (light  gray)  and 
proposed  transform  (black) 


Fig.  3.  Relation  between  proposed  transform  and  grayscale 
histogram  equalization 


mesh  as  discussed  previously.  As  it  operates  independently 
on  each  band  it  should  not  surprise  us  that  it  is  described  by 
a  separable  mesh.  In  fact,  if  Hp>  and  H ^  are  the  red  and 
green  marginal  cumulative  histograms,  vertical  lines  are  de¬ 
fined  by  Hft  1  (k/N)  and  horizontal  lines  by  Hq  1(k/N) 
as  discussed  in  4.  As  the  marginal  histograms  are  almost 
uniform,  the  cumulative  marginal  histograms  (and  their  in¬ 
verses)  are  close  to  the  identity  function  y  =  x  and  the  re¬ 
sulting  mesh  is  almost  uniform. 

On  the  contrary,  the  mesh  of  the  proposed  equalization 
is  free  from  the  separability  constraint  and  makes  an  optimal 
use  of  the  color  space  by  fitting  exactly  the  histogram  of  the 
input  image. 

When  applied  to  a  full  RGB  image  (fig.  4(j))  the  pro¬ 
posed  algorithm  (fig.  4(k))  clearly  makes  an  optimal  use  of 
all  available  colors  which  leads  to  a  much  more  vivid  result 
than  independent  band  GHE  (fig.  4(i)). 

6.  CONCLUSION 

In  this  paper  we  proposed  an  extension  of  grayscale  his¬ 
togram  equalization  to  color  images.  This  method  can  be 
applied  to  spatial  and  color  spaces  of  any  dimension.  Con- 
trarily  to  previous  color  histogram  equalization  methods, 
the  resulting  color  histogram  defined  as  a  function  Mn  — >  M 
is  constant  which  means  that  all  colors  are  being  used  with 
the  same  frequency  in  the  image. 

As  in  grayscale  histogram  equalization  this  can  be  ex¬ 
tended  to  histogram  specification.  Given  two  images  I  and 
K ,  if  Tj  and  Tk  are  the  equalizing  transforms  then  Tk° 
T/(7)  will  be  a  new  version  of  I  with  the  same  histogram 
as  K. 
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(a)  Histogram  of  band- 
equalized  image 


(b)  Equivalent  mesh  (c)  Independent  band-equalized  im- 

of  independent  band  age 

grayscale  histogram 
equalization 


(d)  Histogram  of  orig¬ 
inal  image 


(e)  Original  RG  image 


(f)  Histogram  of  color- 
equalized  image 


(g)  Mesh  of  proposed 
transform 


(h)  Color-equalized  image 


(i)  Independent  band  grayscale  histogram  (j)  Original  RGB  image  (k)  Color-equalized  image 

equalization 


Fig.  4.  Examples.  These  are  color  images. 


